18.05 Lecture 27 
April 15, 2005 



Take sample Xi, ...,X„ ~ N{0, 1) 

^/n{x - n) 



Ar(0,l),5=!^(^^~xLr 



(7 (T^ 

A, B - independent. 

To determine the confidence interval for fi, must eliminate a from A: 



n— 1 



Where Zo,Zi,..,Z„_i~ TV (0,1) 

The standard normal is a symmetric distribution, and :^^{Zf + ... + — > EZf = 1 



'n.-,l 



So ^^-distribution still looks like a normal distribution (especially for large n), and it is symmetric about 



zero. 



Given a G (0, 1) find c, t„_i(— c, c) = a 



-c< 



< c 



B 



with probability = confidence (a) 



Vnjx-iJ,) j 1 n(a;2-(x)2) ^ ^ 



(T 



n — 1 cr^ 



X — u 

-c < _ < c 



X — c 



1 



-(x2 - (x)2) < /X < ^ + cW (a;2 - (x)2) 

1 V « — 1 



1 



By the law of large numbers, x — > EX = fi 

The center of the interval is a typical estimator (for example, MLE). 

error cx estimate of variance « a/ — for large n. 

^2 _ ^2 _ jg sample variance and it converges to the true variance. 
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by LLN ^ cr^ 

= E^ixj + ... + xl) - IE(^(a;i + ... + Xn)f = 
= EXf - ^ ^EXiXj- = EX^ - -^{nEX^ + n{n + l){EXif) 

Note that for i ^ j,EXiXj = EXiEXj = {EXif = jj?, n(n - 1) terms with different indices. 

= "^EXl - "^{EXrf = 
n n 



n 



'-(^X( - (^XiY) 



Var(Xi) 



n- 1 



Therefore: 



Ea^ 



n-1 



-a < a 



Good estimator, but more often than not, less than actual. 
So, to compensate for the lower error: 

E^a^ = 
n—1 

Consider (ct')^ = ^j^jo-^, unbiased sample variance. 



±c 



^—(a;2 - te)2) = ±cJ ^— <t2 = ±cJ 
n—1 y n— 1 \ n 



x-c\l - — — < n<x + c\ 

n \ n 



§7.5 pg. 140 Example: Lactic Acid in Cheese 

0.86, 1.53, 1.57, 1.58, n =^0 

~ Niii,cr^),x = 1.379,a'^ = x^ - (x)^ = 0.0966 

Predict paramctcirs with confidence a = 95% 

Use a t-distribution with n - 1 = 9 degrees of freedom. 





//\ 
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See table: (-00, c) = 0.975 gives c = 2.262 



X - 2.262^/ia2 <n<x + 2.262^^0-2 



0.6377 < < 2.1203 

Large interval due to a high guarantee and a small number of samples. 
If we change a to 90% c = 1.833, interval: 1.189 < /i < 1.569 
Much better sized interval. 

Confidence interval for variance: 

Cl < < C2 



where the c values come from the distribution 




Not symmetric, all positive points given for distribution. 

Cl = 2.7, C2 = 19.02 ^ 0.0508 < < 0.3579 

again, wide interval as result of small n and high confidence. 



Sketch of Fisher's theorem. 

~7V(0,1) 

= -^{Zi + ... + Zn) ~ N{0, 1) 



n ^-^ n ^-^ ^-^ ^/n 



Xn— 1 



f{z,,...,zn) = (-|=re-V2E.? = (4=)"^" 



l/2r' 



1 



The graph is symmetric with respect to rotation, so rotating the coordinates gives again i.i.d. standard 
normal sequence. 

n ^ yi, y„ - iA.d.N{Q, 1) 

V ZTT 



Choose coordinate system such that: 

1 / , . ^ , 1 1 , 

j/i = —;={zi + ... + Zn), I.e. vi = . . . , — =) - new first axis. 

Choose all other vectors however you want to make a new orthogonal basis: 
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yj + ...+yl=zl + ..+ 
since the length does not change after rotation! 

= ?/i ~ N{0, 1) 
n(^-{zr) = Y,y^-yl = yl + .. 

** End of Lecture 27 
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